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Get the Haskell lib.: cabal install testing-feat 


Example 


*Main> index (lO 100 ) :: ([[Boo/]], [Bool]) 
([[],[],[ False , False , True , True] ,...[ False], []], 
[ True , True , False , Fa/se]) 






Property Based Testing of large AST types 


Use case: test pretty-print + parse for Template Haskell, 
data Exp = VarE Name \ CaseE Exp [Match] \ ... — 18 Con 


Property Based Testing of large AST types 


Use case: test pretty-print + parse for Template Haskell, 
data Exp = VarE Name \ CaseE Exp [Match] \ ... — 18 Con 

data Match = Match Pat Body [Dec] 


Property Based Testing of large AST types 


Use case: test pretty-print + parse for Template Haskell, 

data Exp = VarE Name \ CaseE Exp [Match] \ ... — 18 Con 

data Match = Match Pat Body [Dec] 


data Pat = LitP Lit \ ViewP Exp Pat \ ... — 14 Con 

data Body = GuardedB [(Guard,Exp)] \ NormalB Exp 

data Dec = FunD Name [Clause] \ ... - 14 Con 


Property Based Testing of large AST types 


Use case: test pretty-print + parse for Template Haskell, 

data Exp = VarE Name \ CaseE Exp [Match] | ... — 18 Con 

data Match = Match Pat Body [Dec] 


data Pat = LitP Lit \ ViewP Exp Pat | ... — 14 Con 

data Body = GuardedB [(Guard,Exp)] \ NormalB Exp 

data Dec = FunD Name [Clause] \ ... - 14 Con 


data Clause = Clause [Pat] Body [Dec] 

Around 10 datatypes, around 100 constructors. 


Enumerating by size 


Enumeration of [Bool] 

{ [] , [False], [ True] , [False, False] , [False, True] ... 

index 0 [ ] 

index 1 [False] 

index 2 [ True] 


Partitioning by size 


Partitioning of [Bool]\ 

{ 

{}, 

{[]}. 

{}, 

{ [False] [ True] }, 

{}. 

{ [False, False] , [False, True ]. 


0 Constructors 

1 Constructor 

2 Constructors 


An infinite sequence of finite sequences 


Spec, of functional enumerations, part 1 


type E a — fun. enum. of values of type a 
type Fa — similar but for finite enum. 
sel :: E a Part —f F a — pick one finite enum. 

card :: F a —> IN — get its cardinality 

index F :: F a —> Index —> a — ... and its elements 

— where Part = Index = H 
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Spec, of functional enumerations, part 1 


type Fa — fun. enum. of values of type a 
type Fa — similar but for finite enum. 
sel :: E a Part —» F a — pick one finite enum. 
card :: F a —>■ IN — get its cardinality 

index F :: F a —> Index —)• a — ... and its elements 
— where Part = Index = IN 

Possible implementations of F and E\ 

type F a = (IN, Index —» a) — we will use this 

type F' a = [a] — not this 

type E a = [F a] — but we use (roughly) this 

type E' a = Part —>• F a - not this 




Spec, of functional enumerations, part 2 


Set operations for E and for F: 


empty: 

E a 


sing : 

a —y E a 


(®) : 

E a —y E a —y E a 

— merge two enum.s 

(®) : 

Ea^Eb^E (a xb) 

— diagonalisation 

pay 

E a^Ea 

— increase cost (size) 

fmap : 

(a —y E) —y E a —y E b 


empty F 

..Fa 


sing F 

: :a —y F a 


(® F ) 

:: F a —>■ F a —y F a 


(0 F ) 

::F a^y F b^y F {axb) 







Example enumeration of a simple datatype 


data T = L\ST\BTT 


instance Enumerable T where 
enumerate = pay (pure L 

© pure S © enumerate 
© pure B © enumerate © enumerate ) 


[(o,[]), 

(i 

(Us/.]), 

(2 ,[S(SL),BLL]), 

(4 ,[S(S(SL)),S(BLL),BL(SL),B(SL) L}) 


Spec, of functional enumerations, part 3 


sel wE a -» Part -> F a 

sel (pay e) 0 = empty F 

sel ( pay e ) (p + 1) = sel e p 

sel empty p = empty F 

sel (sing x) 0 = sing x 

sel [sing x) (p+ 1) = empty F 

sel (a © b) p = sel a p © F sel b p 

p 

sel (a© b) p = 0 (sel a k ® F sel b(p- k )) 

k=0 


Functional finite sequences 


data Finite a = F 
{ card F :: Integer 

, index F :: Integer —»• a} — between 0 and carc/ F — 1 


Functional finite sequences 


data Finite a = F 
{ card F :: Integer 

, index F :: Integer —»• a} — between 0 and carc/ F 

Finite a « [a] 
card F «length 
index F ~(M) 


empty F :: Finite a 
empty F = F 0 (A/ ->• _L) 


sing F :: a —>• Finite a 
sing F a = F 1 one where 
one 0 = a 
one _ = _L 


empty F ~ [ ] 
sing F ss (:[]) 



map F :: (a —¥ b) —> Finite a —Finite b 
map F f (F c ix) = F c (f o ix) 



(© F ):: Finite a —> Finite a —► Finite a 
fl © F f2 = F car ix where 
car = card F fl + card F f2 
ix i = if / < carc/ F fi 
then index F fl i 
else index F f2{i — card F fl ) 


(® F ) *(-*+) 

(xs 4© ys) !! /' s xs !! / for i < length xs 

m ys !! (/ — length xs) for i ^ length xs 



fl <g) F f2 = F car ix where 
car = card F fl * card F f2 
ix i = let (c/, m) = (/' 1 divMod 1 card F f2 ) 
in ( index F fl d, index F f2 mi) 


[(x,y) | x xs,y ys] ~ xs <S> F ys 

[(x,y) | x xs,y ys]!! / = 

(xs !! div i lys.ys !! mod i lys ) 
where lys = length ys 



Infinite enumerations 


newtype Enumerate a—E {parts :: [Finite a]} 

— Actual implementation also store 

-- the reversals of all initial segments of the list 


empty:: Enumerate a 
empty = E (repeat empty ) 

sing :: a —>■ Enumerate a 

sing a = E ([ sing F a] -H- repeat empty F ) 

fmap :: (a —»> b) — ¥ Enumerate a —>■ Enumerate b 
fmap f = Eo fmap ( map F f ) o parts 



(©):: Enumerate a —> Enumerate a —> Enumerate a 
(©) el e2 = ESzipWith (® F ) (parts el) (parts e2 ) 



Each part of a product is a finite convolution sum: 

(ei <8> e2)! n 

m e \! 0 g F e 2 ! n 
© F ei! 1 ® F e2 ! (n- 1) 

© F ••• 

ei! n <g> F &2 ! 0 

= coneatp 
(zipWith ((g) F ) 

(parts ei) 

(reverse (take n (parts € 2 )))) 


e \ n = parts e !! n 
concatp = foldr (® F ) empty F 



(®):: Enumerate a —* Enumerate b —> Enumerate (a, b ) 
xs(g)ys = E$ map (conv ( parts xs)) 

(reversals (parts ys)) 

conv :: [Finite a] —> [Finite b] -» Finite (a, £>) 
com/ xs ys = concatp (zipWith (® F ) xs ys) 
reversals :: [a] —»• [[a]] 
reversals = go [ \ where 
go rei/ (x: xs) = let rev' = x : rev 
in rev'\ go rev'xs 



Assigning costs 


pay :: Enumerate a —> Enumerate a 
pay e = E $ empty F : parts e 


Assigning costs 


pay :: Enumerate a —> Enumerate a 
pay e = E $ empty F : parts e 

Guarded recursion operator: 

fix pay — empty 


Examples 


enumBool = pay $ sing False © sing True 


*Main> map card F (parts enumBool) 

[ 0 , 2 , 0 , 0 , 0 , 0 ... 


Examples 


data N = Ze \ Su N deriving Show 
enurriN = pay $ sing Ze © fmap Su enum /y 


*Main> map card F (parts enum /y) 

[ 0 , 1 , 1 , 1 , 1 , 1 , 1 , 1 , 1 , 1 , 1 ... 


Examples 


entvm [eoo/] = pay $ 
sing []® 

fmap (uncurry (:)) (enum Boo i <g> enum[ Boo iyj 


*Main> map card F (parts enum^ Boo ij) 
[ 0 , 1 , 0 , 2 , 0 , 4 , 0 , 8 , 0 , 16 , 0 , 32 , 0 , 64 , 0 , 128 , 0 , 256 , 0 ... 


Absolute indexing 


index ':: Enumerate a —> Integer —> a 
index' = index F o concatp o parts 


Absolute indexing 


index ':: Enumerate a —> Integer —> a 
index' = index F o concatp o parts 


Consider: 

length (repeat ()) = _L 
repeat ()!!/ = () 


Random selection 


uniformp :: Finite a —> Gen a 

uniformf f = HftM ( index F f) (choose (0, card F f — 1)) 


Random selection 


uniformp :: Finite a —> Gen a 

uniformp f = HftM ( index F f) (choose (0, card F f — 1)) 


uniform :: Enumerate a —> Int —>■ Gen a 

uniform e n = uniformp $ concatp $ take n $ parts e 


An algebra of Functional Enumerations 

o Concise definition (complete implementation in slides) 
o Nice algebraic properties 
• Automatically derivable for algebraic data types 
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9 Actually finds bugs 

• Particularly useful for large abstract syntax tree types 
® Found errors in haskell-src-exts and template-haskell 

• Neither SmallCheck nor QuickCheck finds these bugs 



Have some untested code lying around? 
® cabal install testing-feat 
® import Test.Feat 


Try it 


Have some untested code lying around? 
® cabal install testing-feat 
® import Test.Feat 


Thank you! 


